Tensor renormalization group approach to 2D classical lattice models 
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FIG. 1: A tensor network model on the honeycomb lattice. 
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where the product includes a tensor for each site of the 
lattice (Fig. [1]). The partition function is the sum of all 
the weights: 
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We describe a simple real space renormalization group technique for two dimensional classical 
lattice models. The approach is similar in spirit to block spin methods, but at the same time it 
is fundamentally based on the theory of quantum entanglement. In this sense, the technique can 
be thought of as a classical analogue of DMRG. We demonstrate the method - which we call the 
tensor renormalization group method - by computing the magnetization of the triangular lattice 
Ising model. 



Introduction: The density matrix renormalization 
group (DMRG) technique has proved extraordinarily 
powerful in the analysis of one dimensional quantum sys- 
tems. [l|, Thus it is natural to try to develop an analo- 
gous renormalization group method in higher dimensions. 
Such a method could solve many currently intractable 
problems (such as the 2D Hubbard model). 

Recent work has focused on generalizing DMRG to 
higher dimensional quantum systems. Q But it is also 
natural to try to generalize to higher dimensional clas- 
sical lattice models. While classical real space renor- 
malization group methods (such as block spin methods 
[3|) have been around for many years, they have never 
achieved the generality or precision of DMRG. 

In this paper, we address this problem in the two di- 
mensional case. We use ideas from quantum informa- 
tion theory to develop a numerical renormalization group 
method that can effectively solve any two dimensional 
classical lattice model. The technique - which we call 
the tensor renormalization group (TRG) method - has 
no sign problem and works equally well for models with 
complex weights. 

Accurate numerical methods based on transfer matri- 
ces [1, Q have already been developed for 2D classical 
systems. The advantage of the approach described here is 
that it is a fully isotropic coarse graining procedure, sim- 
ilar in spirit to block spin methods. It is thus naturally 
suited to investigating universal long distance physics. 
Also, on a more theoretical level, the method reveals the 
relationship between classical RG and quantum entangle- 
ment. Finally, if only for its simplicity, we feel that the 
method is a useful numerical tool in two dimensions as 
well as a natural candidate for higher dimensional gener- 
alizations. 

Tensor network models: The tensor renormalization 
group method applies to a set of classical lattice mod- 
els called "tensor network models." Many well known 
statistical mechanical models, such as the Ising model, 
Potts model, and the six vertex model, can be written 
naturally as tensor network models. In fact, as we show 
later, all classical lattice models with local interactions 
can be written as tensor network models. 

To describe a tensor network model on the honeycomb 
lattice, one must specify a (cyclically symmetric) tensor 
Tijk with indices k running from 1 to for some D. 
The corresponding tensor network model has a degree 
of freedom i = 1, on each bond of the honeycomb 
lattice. The weight for a configuration k, ...) is given 
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In other words, the partition function is obtained by tak- 
ing the product of all the tensors, contracting the pairs 
of indices on each bond. 

The TRG method: The tensor renormalization group 
method is a way to compute the partition function Z 
using a real space RG flow. We explain the method in 
the case of the honeycomb lattice. Each coarse graining 
iteration is made up of two separate steps. The first is 
approximate, and the second is exact (Fig. [5]). The first 
step is to find a tensor S such that 
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(We explain how to find such a tensor S at the end of 
this section). The relation is a very useful property. 
Geometrically, it means that we can reconnect the lattice, 
making the replacement 



(4) 



wherever we like, without affecting the partition func- 
tion Z . Applying this to the bonds shown in Fig. [2^, we 
change the honeycomb lattice to the new lattice shown 
in Fig. ^p. The partition function is now given by con- 
tracting the S tensors on the new lattice. 



FIG. 2: A TRG transformation on the honeycomb lattice. 




FIG. 3: A TRG transformation on the square lattice. 



The second step is now clear. We group together 
triplets of neighboring points replacing them by a sin- 
gle lattice point with a coarse-grained tensor T': 




Here the tensor T' is given by contracting over the three 
bonds of the triangle: 

'^ijk ~ "^^SkpqSjqrSirp (6) 
pqr 

Making this replacement everywhere gives a new 
(coarser) honeycomb lattice (see Fig. [5J;). This com- 
pletes the coarse graining transformation. The end result 
is that the number of points in the lattice has decreased 
by a factor of 3 and T has been replaced by T'. 

Iterating this procedure, one can compute the parti- 
tion function of an arbitrarily large finite lattice. Ther- 
modynamic observables and correlation functions can be 
obtained by taking numerical derivatives of -F = — log Z , 
or by evaluating the free energy of more general models 
where the tensors T^jfe vary from site to site. An addi- 
tional feature is that the tensors T converge to a fixed 
point tensor T* - whose physical significance we explain 
in the next section. The method is not limited to the hon- 
eycomb lattice and can easily be implemented on other 
lattices (see Fig. [S]). 

To complete the discussion, we address the issue of 
finding a tensor S which satisfies The first step is to 
think of Yjni TijmTkim a.sa.D^ X matrix M: Mujk 

'^ijmTkim- It is also uscful to think of the tensor Sun 
as a X D matrix Su^n- Then the problem of satisfying 
([3]) is the problem of finding a x D matrix S such 
that M = S ■ 5'^. In general, this factorization cannot be 
done exactly since the left hand side typically has rank 
D^, while the right hand side has rank at most D. 



(a) (b) 

FIG. 4: After (a) dividing R into triangles, (b) the parti- 
tion function of each triangle can be written as a function 
*({'^a„}, {o"6„}, {o"c„}) of the boundary spins. 



However an approximate solution can be obtained as 
follows. The idea is to choose the matrix S that mini- 
mizes the error, \M — S ■ S'^\'^; the optimal S can then 
be found using the singular value decomposition of M . 
In more detail: first one writes Mujk — J2n SnUu.nV*/^ „ 
(here, Sn are the singular values and U, V are unitary 
matrices). Second, one truncates the matrices Uu^n, Vjk.n 
keeping only those columns corresponding to the largest 
D singular values. The result are x D matrices 
UH,n, Vjk,n- Finally, one sets Sun = ^/s^Uu^n- This gives 
the required factorization - provided that we adjust the 
phase ambiguity J7ii,ne"^", V,fc,« ^ V^fe^ne"**^" 

appropriately. In practice, it is often more convenient 
to ignore the phase adjustment issue and set S{1^ = 
y/s^Uii^„, S^f.^ = v^^fc ra- The result is a factorization 
En SLSfun « Em T^jruTkim whcrc and difi^er by 
some phase factors. The TRG procedure can be applied 
as before - the only difference being that we have to keep 
track of two different tensors T^,T^ for the A and B 
sublattices. 

We will show in the next section that the error for this 
optimal decomposition is independent of the number of 
iterations and can be made arbitrarily small by increas- 
ing D. Indeed, the error vanishes as e ~ exp(— const • 
(logZ?)^) - the same scaling behavior as the truncation 
error in DMRG. 3 

Physical picture: In this section we explain the physics 
behind the TRG method, and give a physical inter- 
pretation of the fixed point tensor T* . We begin by 
showing how arbitrary classical models in two dimen- 
sions can be thought of as tensor models on the hon- 
eycomb lattice. For concreteness we frame our discus- 
sion around the case of the square lattice Ising model, 
Z = E{a }^^P(^E{ij)'^i'^j)- Consider the partition 
function Zn for some finite region R in the plane. One 
way to compute Zfi is to triangulate R, dividing it into 
triangles of size L much larger than the lattice spacing I 
(Fig. Hi). 

Consider one of the triangles. Imagine summing over 
all the lattice degrees of freedom within the triangle. The 
result will yield some number = '^{{<Ji„}) that depends 
on the values of {ci^} at the boundary of the triangle 
(Fig. IIId). It is convenient to separate out these boundary 
degrees of freedom into three groups {cTa,,}, Wb^}, Wc^} 
corresponding to the three sides a, 6, c of the triangle. 




(a) (b) (c) 



FIG. 5: The tensor renormalization group transformation 
can be viewed as a two step change in the triangulation of R. 

Denoting {cTa^} schematically by a, and similarly for 
{(7bn}i {fc„}j we can think of ^E" as a three index tensor 

To obtain the partition function for the region R, 
we simply need to glue together all the triangles and 
then sum over the spins at their boundaries: Z/j = 
Sa/37(5e ^a/37^Q5e • ■ • ■ This is nothing but the partition 
function of a tensor model (Actually, a more care- 
ful analysis shows that the resulting tensor model has 
different tensors vl/^,vl/^ for the A^B sublattices) . 

It is useful to think about the tensor renormalization 
group transformation in this context. Recall that the 
first step is to find tensors S satisfying '^^SunSjkn ~ 
J2m'^vmTkim- Thinking in terms of the triangles, 
the right hand side is simply the partition function of 
the rhombus obtained by gluing two triangles together. 
Thus, a solution S can be constructed by setting S equal 
to the partition function of one of the obtuse triangles 
obtained by dividing the rhombus in the other direction: 




(7) 



Thus, the first step of the renormalization transforma- 
tion process simply changes the triangulation as shown 
in Fig. [5}d. The second step also has a simple interpreta- 
tion. Examining the definition of T', it is not hard to see 
that T' is simply the partition function of a large equi- 
lateral triangle, obtained by gluing together three obtuse 
triangles: 




(8) 



Thus, the second step simply glues together triplets of 
obtuse triangles to form larger equilateral triangles as 
shown in Fig. [SJ;. In this way, the TRG method builds 
up larger and larger triangles. 

However, there is one subtlety. As we build up larger 
and larger triangles, the corresponding tensors will have 
indices with larger and larger ranges, increasing from 2^/' 
to 2^^/' to 2^^/' and so on. Yet, the TRG method 
insists on approximating these tensors by a tensor with a 
fixed range D. How can this approximation possibly be 
accurate? 

To answer this question, we must explain the physical 
meaning of "^ap-y. Let ^' be a tensor obtained from the 
partition function of a very large triangle. Writing out 
the labels a, /?, 7 explicitly, we can write 5* as a function 




(a^- a)/a^ 



FIG. 6: The magnetization of the triangular lattice Ising 
model as a function of q = e"^*^"^, obtained using the TRG 
method. 

"^{Wa^}, Wb„}, {fc„}) of the spins on the three sides of 
the triangle. In fact, this function should be thought 
of as a wave function for a one dimensional quantum 
spin system with spins living on the boundary of a tri- 
angle. This interpretation comes from thinking of the 
original 2 dimensional classical model (e.g. the Ising 
model) as a (1-1-1) dimensional quantum model. We 
think of the direction parallel to the boundary of the 
triangle as space, and the (radial) direction perpendic- 
ular to the boundary as time. We imagine constructing 
a one dimensional transfer matrix/quantum Hamiltonian 
H living on the boundary of the triangle, whose (radial) 
time evolution generates the two dimensional classical 
model in question. Then in this picture, the function 
'^iWa,,},Wb„},{o'c,,}) is the result of evolving H for a 
long time (the triangle is large). Hence ^' is simply the 
ground state of i? - up to exponentially small corrections. 

If we assume that the original classical model (e.g. the 
Ising model) is not critical, then is the ground state 
of a gapped Hamiltonian. Gapped ground states in one 
dimension have an important property: they are only 
weakly entangled. More specifically, it is known that the 
density matrix p{x, L) of a region of size x converges to 
a fixed density matrix p^o as x, L — > c». Moreover, the 
size of the mth eigenvalue Am of poo falls off rapidly with 
increasing to: Am ~ exp(— const • log(TO)^). [§1 

It is this property which guarantees the accuracy of the 
TRG method. Indeed, as a consequence of this property, 
one can factor ^ into a product of three spin states on 
the three sides of the triangle, 

D 

*(a„ab,a,) « T^Jk^\{aa)■^'Bi^b)■^U^c) (9) 

ijk—l 

with high accuracy. Such a factorization can be obtained 
by choosing ^f^, 5*^, to be the ith largest eigenstates 
of the density matrices of sides A,B,C, and letting Tijk 
be the matrix elements of the tensor \l/(cra, at,, ctc) be- 
tween these states. By the discussion above, the error e 
of this representation is (1) independent of the size L of 
the triangle, and (2) decreases rapidly with increasing D 
(e ~ exp(— const • (logD)^)). 
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Thus, even though the exact tensor '^afSj has an expo- 
nentially large range, one can make a change of basis so 
that in that basis, ^' can be accurately approximated by a 
tensor Tijk whose indices have a fixed range D. The TRG 
method can be thought of as a numerical technique for 
(approximately) constructing this tensor Tijk for larger 
and larger triangles. The fixed point T* is the value of 
this tensor in the limit of an infinitely large triangle. 

The above analysis was based on the assumption that 
the classical model was not critical. If instead the clas- 
sical model is critical, the associated quantum states are 
gapless ground states. Gapless ground states are more 
entangled then their gapped counterparts. The entan- 
glement entropy S — —Tr^plogp) of a region of size x in 
a system of size L grows logarithmically with the region 
size, S ~ logx. This means that the factorization ^ 
will always break down when the triangle is sufficiently 
large. Thus, in principle the TRG method - like DMRG 
Q- breaks down at criticality. 

A simple example: In this section we demonstrate the 
method with a simple example: the triangular lattice 
Ising model: Z — J2{a} ^^P(f^'^^{ij) '^i'^j)- Note that 
the Ising model partition function can be written as a 
sum over domain wall configurations where the domain 
walls live on the bonds of the honeycomb lattice. This 
domain wall model can be easily realized by a tensor net- 
work with D = 2. We think of the state i = 1 as denoting 
"no domain wall" and i = 2 as denoting "domain wall." 
Then the tensor with nonzero components 

ylll ^ , yl22 ^ y212 ^ y221 ^ ^ (10) 



a = e '^^•^ gives rise to the correct Boltzmann weight. 

Applying the TRG method to the above tensor, we 
compute the free energy per unit spin, F — -—-^ log(2') 
in the thermodynamic limit N ^ oo. The magnetization 
M can be obtained by taking numerical derivatives of F 
(though we need to use a more complicated tensor T to 
represent an Ising model with an external magnetic field 
H). Increasing D, the computation rapidly converges 
to the exact result [lo| except in an increasingly narrow 
interval around the critical point ac = 1/a/3 (Fig. [S]). 

This interval becomes so narrow that one can study 
the critical point itself. For example, the magnetization 
curve for D — 34 predicts an ac within 10^"* of the exact 
result. One can even estimate the critical exponent /3 
from the scaling behavior of the magnetization. We find 
f3 — 0.12, not far from the exact value /? = 1/8. How- 
ever, as explained earlier, the TRG method (like DMRG) 
is best suited to studying systems off criticality. An inter- 
esting question for further research is whether the TRG 
method can be modified so that it's (almost exponential) 
accuracy is uniform, both away from and near critical 
points. 
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